A Common Mechanism for Adaptive Scaling of Reward and Novelty

Declarative memory is remarkably adaptive in the way it maintains sensitivity to relative novelty in both unknown and highly familiar environments. However, the neural mechanisms underlying this contextual adaptation are poorly understood. On the basis of emerging links between novelty processing and reinforcement learning mechanisms, we hypothesized that responses to novelty will be adaptively scaled according to expected contextual probabilities of new and familiar events, in the same way that responses to prediction errors for rewards are scaled according to their expected range. Using functional magnetic resonance imaging in humans, we show that the influence of novelty and reward on memory formation in an incidental memory task is adaptively scaled and furthermore that the BOLD signal in orbital prefrontal and medial temporal cortices exhibits concomitant scaled adaptive coding. These findings demonstrate a new mechanism for adjusting gain and sensitivity in declarative memory in accordance with contextual probabilities and expectancies of future events. Hum Brain Mapp, 2010. © 2010 Wiley-Liss, Inc

Substantia nigra activity level predicts trial-to-trial adjustments in cognitive control

Effective adaptation to the demands of a changing environment requires flexible cognitive control. The medial and the lateral frontal cortices are involved in such control processes, putatively in close interplay with the BG. In particular, dopaminergic projections from the midbrain (i.e., from the substantia nigra [SN] and the ventral tegmental area) have been proposed to play a pivotal role in modulating the activity in these areas for cognitive control purposes. In that dopaminergic involvement has been strongly implicated in reinforcement learning, these ideas suggest functional links between reinforcement learning, where the outcome of actions shapes behavior over time, and cognitive control in a more general context, where no direct reward is involved. Here, we provide evidence from functional MRI in humans that activity in the SN predicts systematic subsequent trial-to-trial RT prolongations that are thought to reflect cognitive control in a stop-signal paradigm. In particular, variations in the activity level of the SN in one trial predicted the degree of RT prolongation on the subsequent trial, consistent with a modulating output signal from the SN being involved in enhancing cognitive control. This link between SN activity and subsequent behavioral adjustments lends support to theoretical accounts that propose dopaminergic control signals that shape behavior both in the presence and in the absence of direct reward. This SN-based modulatory mechanism is presumably mediated via a wider network that determines response speed in this task, including frontal and parietal control regions, along with the BG and the associated subthalamic nucleus

Functional coupling between CA3 and laterobasal amygdala supports schema dependent memory formation

The medial temporal lobe drives semantic congruence dependent memory formation. However, the exact roles of hippocampal subfields and surrounding brain regions remain unclear. Here, we used an established paradigm and high-resolution functional magnetic resonance imaging of the medial temporal lobe together with cytoarchitectonic probability estimates in healthy humans. Behaviorally, robust congruence effects emerged in young and older adults, indicating that schema dependent learning is unimpaired during healthy aging. Within the medial temporal lobe, semantic congruence was associated with hemodynamic activity in the subiculum, CA1, CA3 and dentate gyrus, as well as the entorhinal cortex and laterobasal amygdala. Importantly, a subsequent memory analysis showed increased activity for later remembered vs. later forgotten congruent items specifically within CA3, and this subfield showed enhanced functional connectivity to the laterobasal amygdala. As such, our findings extend current models on schema dependent learning by pinpointing the functional properties of subregions within the medial temporal lobe

Neural oscillations and event-related potentials reveal how semantic congruence drives long-term memory in both young and older humans

Long-term memory can improve when incoming information is congruent with known semantic information. This so-called congruence effect has widely been shown in younger adults, but age-related changes and neural mechanisms remain unclear. Here, congruence improved recognition memory in younger and older adults (i.e. congruence effect), with only weak evidence for age-related decline in one behavioral study. In an EEG study, however, no significant behavioral differences in the congruence effect could be observed between age-groups. In line with this observation, electroencephalography data show that, in both groups, congruence led to widespread differences in Event-Related Potentials (ERPs), starting at around 400ms after stimulus onset, and theta, alpha and beta oscillations (4-20Hz). Importantly, these congruence-related ERPs were associated to increases in memory performance for congruent items, in both age groups. Finally, the described ERPs and neural oscillations in the theta-alpha range (5-13Hz) were less pronounced in the elderly despite a preserved congruence effect. Together, semantic congruence increases long-term memory across the lifespan, and, at the neural level, this could be linked to neural oscillations in the theta, alpha and beta range, as well as ERPs that were previously associated with semantic processing

Semantic Congruence Drives Long-Term Memory and Similarly Affects Neural Retrieval Dynamics in Young and Older Adults

Learning novel information can be promoted if it is congruent with already stored knowledge. This so-called semantic congruence effect has been broadly studied in healthy young adults with a focus on neural encoding mechanisms. However, the impacts on retrieval, and possible impairments during healthy aging, which is typically associated with changes in declarative long-term memory, remain unclear. To investigate these issues, we used a previously established paradigm in healthy young and older humans with a focus on the neural activity at a final retrieval stage as measured with electroencephalography (EEG). In both age groups, semantic congruence at encoding enhanced subsequent long-term recognition memory of words. Compatible with this observation, semantic congruence led to differences in event-related potentials (ERPs) at retrieval, and this effect was not modulated by age. Specifically, congruence modulated old/new ERPs at a fronto-central (Fz) and left parietal (P3) electrode in a late (400-600 ms) time window, which has previously been associated with recognition memory processes. Importantly, ERPs to old items also correlated with the positive effect of semantic congruence on long-term memory independent of age. Together, our findings suggest that semantic congruence drives subsequent recognition memory across the lifespan through changes in neural retrieval processes

Theta-alpha oscillations bind the hippocampus, prefrontal cortex, and striatum during recollection: Evidence from simultaneous EEG-fMRI

Recollection of contextual information represents the core of human recognition memory. It has been associated with theta (4-8 Hz) power in electrophysiological recordings and, independently, with BOLD effects in a network including the hippocampus and frontal cortex. Although the notion of the hippocampus coordinating neocortical activity by synchronization in the theta range is common among theoretical models of recollection, direct evidence supporting this hypothesis is scarce. To address this apparent gap in our understanding of memory processes, we combined EEG and fMRI during a remember/know recognition task. We can show that recollection-specific theta-alpha (4-13Hz) effects are correlated with increases in hippocampal connectivity with the prefrontal cortex and, importantly, the striatum, areas that have repeatedly been linked to retrieval success. Taken together, our results provide compelling evidence that low frequency oscillations in the theta and alpha range provide a mechanism to functionally bind the hippocampus, prefrontal cortex and striatum during successful recollection

Semantic congruence accelerates the onset of the neural signals of successful memory encoding

As the stream of experience unfolds, our memory system rapidly transforms current inputs into long-lasting meaningful memories. A putative neural mechanism that strongly influences how input elements are transformed into meaningful memory codes relies on the ability to integrate them with existing structures of knowledge or schemas. However, it is not yet clear whether schema-related integration neural mechanisms occur during online encoding. In the current investigation, we examined the encoding-dependent nature of this phenomenon in humans. We showed that actively integrating words with congruent semantic information provided by a category cue enhances memory for words and increases false recall. The memory effect of such active integration with congruent information was robust, even with an interference task occurring right after each encoding word list. In addition, via electroencephalography, we show in 2 separate studies that the onset of the neural signals of successful encoding appeared early (∼400 ms) during the encoding of congruent words. That the neural signals of successful encoding of congruent and incongruent information followed similarly ∼200 ms later suggests that this earlier neural response contributed to memory formation. We propose that the encoding of events that are congruent with readily available contextual semantics can trigger an accelerated onset of the neural mechanisms, supporting the integration of semantic information with the event input. This faster onset would result in a long-lasting and meaningful memory trace for the event but, at the same time, make it difficult to distinguish it from plausible but never encoded events (i.e., related false memories)

Does Executive Function Influence Walking in Acutely Hospitalized Patients With Advanced Parkinson's Disease: A Quantitative Analysis

IntroductionIt is well-known that, in Parkinson's disease (PD), executive function (EF) and motor deficits lead to reduced walking performance. As previous studies investigated mainly patients during the compensated phases of the disease, the aim of this study was to investigate the above associations in acutely hospitalized patients with PD.MethodsA total of seventy-four acutely hospitalized patients with PD were assessed with the delta Trail Making Test (ΔTMT, TMT-B minus TMT-A) and the Movement Disorder Society-revised version of the motor part of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS III). Walking performance was assessed with wearable sensors under single (ST; fast and normal pace) and dual-task (DT; walking and checking boxes as the motor secondary task and walking and subtracting seven consecutively from a given three-digit number as the cognitive secondary task) conditions over 20 m. Multiple linear regression and Bayes factor BF10 were performed for each walking parameter and their dual-task costs while walking (DTC) as dependent variables and also included ΔTMT, MDS-UPDRS III, age, and gender.ResultsUnder ST, significant negative effects of the use of a walking aid and MDS-UPDRS III on gait speed and at a fast pace on the number of steps were observed. Moreover, depending on the pace, the use of a walking aid, age, and gender affected step time variability. Under walking-cognitive DT, a resolved variance of 23% was observed in the overall model for step time variability DTC, driven mainly by age (β = 0.26, p = 0.09). Under DT, no other significant effects could be observed. ΔTMT showed no significant associations with any of the walking conditions.DiscussionThe results of this study suggest that, in acutely hospitalized patients with PD, reduced walking performance is mainly explained by the use of a walking aid, motor symptoms, age, and gender, and EF deficits surprisingly do not seem to play a significant role. However, these patients with PD should avoid walking-cognitive DT situations, as under this condition, especially step time variability, a parameter associated with the risk of falling in PD worsens

Effects of positive and negative social feedback on motivation, evaluative learning, and socio-emotional processing

Abstract Social rewards and punishments are strong motivators. Since experimental work has focused on young adults using simplistic feedback, the effects of more naturalistic stimuli on motivation, evaluative learning, and socio-emotional processing with advanced age remain unclear. Therefore, we compared the effects of static (photos) vs dynamic (videos) social feedback in a social incentive delay (SID) task in young (18–35 years) and older adults (50–84 years) with neutral, positive, and negative feedback, on response times (RTs), and assessed the emotional valence of feedback cues and feedback videos. We found that anticipating positive and negative social feedback accelerated RTs regardless of age and without additional effects of video feedback. Furthermore, the results suggest a valence transfer from positive feedback videos to predictive cues in both groups (i.e., evaluative learning). Finally, older adults reported less pronounced negative affect for negative feedback videos, indicating age differences in socio-emotional processing. As such, our findings foster our understanding of the underlying cognitive and emotional aspects involved in the processing of social rewards and punishments